International comparisons of student attainment: some issues arising from the PISA study
نویسنده
چکیده
This paper raises some methodological concerns about the conduct, analysis and interpretation of results from the Programme for International Student Assessment (PISA) study. While, in many respects PISA represents an advance on previous attempts at international comparative assessment studies, it retains certain problematic aspects. The article comments on the restricted nature of the data modelling and analysis, and the resulting interpretations. It points to certain features of the results that raise questions about the adequacy of the data and it stresses the failure to introduce a longitudinal component. The paper makes suggestions for ways in which such studies can be improved.
منابع مشابه
Analyses of model fit and robustness. A new look at the PISA scaling model underlying ranking of countries according to reading literacy.
This paper addresses methodological issues that concern the scaling model used in the international comparison of student attainment in the Programme for International Student Attainment (PISA), specifically with reference to whether PISA's ranking of countries is confounded by model misfit and differential item functioning (DIF). To determine this, we reanalyzed the publicly accessible data on...
متن کاملComments on Kreiner 2011: Is the foundation under PISA solid? A critical look at the scaling model underlying international comparisons of student attainment
i This paper is concerned with two issues: Do the outcomes of PISA – more particularly the rankings – depend on the items chosen? Could alternative scaling procedures, produce different outcomes – more particularly the rankings. A careful examination of these two issues is clearly an important activity that should be the focus of rigorous scholarly investigation. Unfortunately this article ...
متن کاملSchool Quality, Educational Attainment and Aggregation Bias
School Quality, Educational Attainment and Aggregation Bias Data from 31 countries participating in the Programme for International Student Assessment (PISA) is used to estimate education production functions for reading literacy. The analysis suggests that the probability of finding statistically significant and correctly signed class size effects increases the higher the level of aggregation ...
متن کاملHow do american students measure up? Making sense of international comparisons.
In response to frequent news media reports about how poorly American students fare compared with their peers abroad, Daniel Koretz takes a close look at what these comparisons say, and do not say, about the achievement of U.S. high school students. He stresses that the comparisons do not provide what many observers of education would like: unambiguous information about the effectiveness of Amer...
متن کاملComparisons over time in PISA
EDUCATION JOURNAL 17 T wo of the three major international comparison research projects – PIRLS and PISA – were published in late November and early December and in this international supplement we bring you detailed reports on these two programmes and analysis of these and some other international surveys. This supplement is a collaborative effort from NFER’s leading researchers and some of ou...
متن کامل